• 专利附录
  • 专利说明
  • 权利要求
  • 类似技术
  • 同族专利
  • 引用文献
  • 法律状态
  • 优先权
    • 专利摘要:
    Disclosed are a method and device for image processing, and a three-dimensional imaging system. The method comprises: acquiring a two-dimensional image to be processed; aligning said two-dimensional to a grid template; utilizing a grid template table to map said two-dimensional image to produce a first image, where the grid mapping table is used for expressing mapping relations of grid images; mirroring the first image to produce a second image; compounding the first image with the second image to produce a ghosting of the first image and the second image. The present invention utilizes the grid template and the grid mapping table to map said two-dimensional image so as to emulate a left-eye image and a right-eye image acquired by the human eyes; same two-dimensional image to be processed only needs to be mapped once to produce the left-eye image and the right-eye image, steps for image processing are reduced, thus reducing the time spent on image processing, and providing favorable conditions for the degree of real-time in the conversion of subsequent ghosting two-dimensional images into three-dimensional images.
    公开号:ES2813426A1
    申请号:ES202090058
    申请日:2019-05-06
    公开日:2021-03-23
    发明作者:Yi Zhang；To Chin
    申请人:Scivita Med Tech Co Ltd；
    IPC主号:
    专利说明:

    [0001] METHOD AND DEVICE FOR IMAGE PROCESSING, AND SYSTEM OF
    [0003] FIELD OF THE PRESENT DISCLOSURE
    [0005] The present disclosure relates to a technical field of image processing, in particular to an image processing method and device, and a three-dimensional imaging system.
    [0007] BACKGROUND TO THIS DISCLOSURE
    [0009] Stereoscopic vision means that when an object is seen through both eyes by humans, a sensation can arise subjectively, of the thickness of the objects seen, and the depth or distance of space and the like. The main reason is that the images of the same object seen in the retinas of both eyes are not exactly identical, where the left eye sees more of the left side of the object from the left while the right eye sees more of the right side of the object from the left. right; and a stereoscopic image of the object is generated after the image information from both eyes is processed through a senior visual center.
    [0011] With the development of display technology and digital technology, this has become a research hotspot to mimic the stereoscopic vision of human eyes by using electronic products. In the prior art, users can view a 3D image only if a 3D camera device is adopted. Most existing 3D camera devices operate by mimicking the structure of human eyes, each of which comprises two cameras, where an image acquired by one of the cameras corresponds to a left eye image for human eyes, and an image acquired by the other of the cameras corresponds to an image of the right eye for human eyes; and then the left eye image and the right eye image can be synthesized by an image processing means to form the 3D image.
    [0012] In this, for a three-dimensional imaging system in the prior art, the left eye image and the right eye image are acquired by two cameras, respectively; and the two images are processed separately to form subsequent three-dimensional images. However, the image processing method has a relatively long time lag from image acquisition to completion of processing, and is not suitable for some occasions that need relatively high real-time performance.
    [0014] SUMMARY OF THIS DISCLOSURE
    [0016] In view of this, the embodiment of the present disclosure provides an image processing method and device, and a three-dimensional imaging system in order to solve the problem of relatively long time delay in image processing.
    [0018] According to a first aspect, the embodiment of the present disclosure provides an image processing method, comprising the following steps of:
    [0020] acquire a two-dimensional image to be processed;
    [0022] aligning the two-dimensional image to be processed on a grid template, the grid template being used to perform a grid division on the two-dimensional image to be processed;
    [0024] performing mapping processing on the two-dimensional image to be processed using a grid mapping table to acquire a first image, the grid mapping table being used to represent a grid image mapping relationship;
    [0026] replicating the first image to acquire a second image, the first image being a left eye image and the second image being a right eye image; or the first image being a right eye image and the second image being a left eye image; Y
    [0028] synthesize the first image and the second image to acquire an overlay image of the first image and the second image.
    [0030] According to the embodiment of the present disclosure, the grid template and the grid mapping table are used to perform the mapping processing on the two-dimensional image to be processed in order to simulate the left eye image and the eye image. right acquired by human eyes; that is, according to the method, the mapping processing needs to be performed on the same two-dimensional image to be processed only once, the left eye image and the right eye image can be acquired, and consequently the processing steps are reduced therefore, the image processing time is shortened and the conditions are provided for monitoring the real-time conversion of the two-dimensional image superimposed on a three-dimensional image. Referring to the first aspect, in the first form of implementation of the first aspect, the grid mapping table comprises the number of each of the grids in the grid template; and the information of the mapped grid images is stored in the grid mapping table corresponding to the numbers.
    [0032] In accordance with the embodiment of the present disclosure, each of the grids in the grid template is numbered; the numbers correspond to the information of the mapped grid images one by one in order to avoid the confusion of the mapped grid image information that occurs when the plurality of grid images are processed in parallel, and to improve the accuracy of the tracking mapping processing.
    [0034] Referring to the first form of implementation of the first aspect, in the second form of implementation of the first aspect, the realization of the mapping processing on the two-dimensional image to be processed using a grid mapping table to acquire the first image comprises the following stages of:
    [0036] dividing the two-dimensional image to be processed through the grid template to form the plurality of grid images to be processed;
    [0038] acquire the numbers of the grid images to be processed;
    [0040] search the grid mapping table and extract the information from the grid images corresponding to the numbers;
    [0042] processing the grid images to be processed using the information extracted from the grid images; Y
    [0044] combine the processed grid images to be processed to acquire the first image.
    [0046] In accordance with the embodiment of the present disclosure, the corresponding grid image information is extracted from the grid mapping table using the numbers corresponding to each divided grid image to be processed to process the grid images to be processed. In this, since each two-dimensional image to be processed is distinguished by number, simultaneous processing of the plurality of grid images to be processed can be performed, and the efficiency of image processing is improved.
    [0048] Referring to the second form of implementation of the first aspect, in the third form of implementation of the first aspect, the information of the grid images refers to the sizes of the grid images;
    [0050] the processing of the grid images to be processed using the information extracted from the grid images comprises the stage of:
    [0052] scale the grid images to be processed according to the extracted sizes of the grid images.
    [0054] In accordance with the embodiment of the present disclosure, scaling processing is performed on each grid image to be processed using the sizes of the mapped grid images stored in the grid mapping table, that is, the grid images to be processed. they are processed from the perspective of image sizes without involving the resolution and pixels of the images and other information; And thus, on the one hand, the image quality can be guaranteed; and, on the other hand, the processing efficiency can be improved.
    [0056] Referring to the first aspect, in the fourth form of implementation of the first aspect, the synthesis of the first image and the second image to acquire the superimposed image of the first image and the second image comprises the following steps of:
    [0058] aligning a side edge of the first image with a side edge of the second image, where the center point of the side edge of the first image coincides with the center point of the side edge of the second image;
    [0060] translate the first image or the second image along the center lines of the side edges to acquire the overlay image.
    [0062] Referring to the first aspect, in the fifth embodiment of the first aspect, the two-dimensional image to be processed is a frame image in a video playback.
    [0064] According to the second aspect, the embodiment of the invention provides an image processing device comprising:
    [0066] an acquisition module for acquiring a two-dimensional image to be processed;
    [0067] an alignment module to align the two-dimensional image to be processed on the grid template, the grid template being used to perform a division of grid in the two-dimensional image to be processed;
    [0069] a mapping module for performing mapping processing on the two-dimensional image to be processed using the grid mapping table to acquire the first image, the grid mapping table being used to represent the mapping ratio of the grid images;
    [0071] a replication module for replicating the first image to acquire the second image;
    [0073] a synthesis module to synthesize the first image and the second image to acquire an overlay image of the first image and the second image.
    [0075] According to the embodiment of the present disclosure, the grid template and the grid mapping table are used to perform the mapping processing on the two-dimensional image to be processed in order to simulate the left eye image and the eye image. right acquired by human eyes; That is, according to the device, the mapping processing needs to be performed on the same two-dimensional image to be processed only once, the left eye image and the right eye image can be acquired, the image processing steps are reduced, by therefore, the image processing time is shortened and the conditions for monitoring the real-time conversion of the two-dimensional image superimposed on the three-dimensional image are provided.
    [0077] According to the third aspect, the embodiment of the invention provides an image processing means comprising:
    [0079] a memory and a processor, the memory and the processor being in communication connection with each other; computer instructions that are stored in memory; and the processor, executing the computer instructions, implements the image processing method in accordance with the first aspect of the present disclosure or any one of the forms of implementation of the first aspect.
    [0081] In accordance with the fourth aspect, the embodiment of the present disclosure provides a computer-readable storage medium; and the computer instructions are stored on the computer-readable storage medium, and are used to enable a computer to implement the image processing method in accordance with the first aspect of the present disclosure, or any one of the implementation forms of the first appearance.
    [0083] In accordance with the fifth aspect, the embodiment of the present disclosure provides a three-dimensional imaging system comprising:
    [0085] an image acquisition means, comprising a single lens as an image acquiring lens, used to acquire the two-dimensional image to be processed;
    [0087] the image processing means in the third aspect of the present disclosure, electrically connected to the image acquisition means and used to process the two-dimensional image to be processed;
    [0089] an image display means, electrically connected to the image processing means and used to display a three-dimensional image.
    [0091] In the three-dimensional imaging system provided by the embodiment of the present disclosure, the image acquisition means comprises a single lens and does not require the use of two image acquisition systems as the image acquisition means comprising dual lenses. and, therefore, the volume of all the image acquisition means is reduced; And furthermore, the outer diameter of a single lens endoscope can be much smaller than that of a double lens endoscope, such that the three-dimensional imaging system can be used on relatively small sized human organs to perform the training. three-dimensional imaging in human organs, and the application range of the system 3D imaging is further expanded.
    [0093] BRIEF DESCRIPTION OF THE DRAWINGS
    [0095] The features and advantages of the present disclosure will be more clearly understood with reference to the drawings. The drawings are schematic and should not be construed as limiting the present disclosure. In the drawings:
    [0097] Figure 1 is a specific schematic flow diagram of an image processing method in accordance with one embodiment of the present disclosure;
    [0099] Fig. 2 is another specific schematic flow diagram of the image processing method in accordance with the embodiment of the present disclosure;
    [0101] Figure 3 is a specific schematic diagram of the grid template division in the embodiment of the present disclosure;
    [0103] Figure 4 is a schematic diagram illustrating a mapping transformation principle in the embodiment of the present disclosure;
    [0105] Figure 5 is another specific schematic flow diagram of the image processing method in accordance with the embodiment of the present disclosure;
    [0107] Fig. 6 is a schematic diagram of a relationship between a convergence angle and the distance between a left eye image and a right eye image in the embodiment of the present disclosure;
    [0109] Figure 7 is a specific schematic structural diagram of an image processing device in accordance with the embodiment of the present disclosure;
    [0111] Figure 8 is another specific schematic structural diagram of the image processing device in accordance with the embodiment of the present disclosure; Figure 9 is a specific schematic structural diagram of the image processing means in accordance with the embodiment of the present disclosure;
    [0113] Fig. 10 is a specific schematic structural diagram of a three-dimensional imaging system in accordance with the embodiment of the present disclosure.
    [0115] DESCRIPTION OF THE EMBODIMENTS
    [0117] In order to make the objects, technical schemes and advantages of the embodiments of the present disclosure clearer, a clear and complete description of the technical diagrams of the embodiments of the present disclosure will be made with reference to the accompanying drawings according to with the embodiments of the present disclosure. Obviously, the described embodiments are merely a part or not all of the embodiments of the present invention. Based on the embodiments of the present disclosure, all other embodiments acquired by those skilled in the art without creative work fall within the scope of protection of the present invention.
    [0119] An image processing method provided by the present disclosure is used to simulate a left eye image and a right eye image observed by human eyes. Specifically, the mapping processing is performed on an acquired two-dimensional image to be processed in order to create binocular parallax images such as the left eye image and the right eye image, and therefore, stereoscopic vision is performed. Additionally, the left eye image and the right eye image are synthesized to acquire the superimposed image of the first image and the second image to establish a convergence angle. Subsequently, a three-dimensional image can be formed through an image display means of a three-dimensional imaging system according to the present disclosure in combination with the binocular parallax images and the convergence angle.
    [0120] The embodiment of the invention provides the image processing method; and as shown in figure 1, the method comprises the following steps of:
    [0122] 511. acquire a two-dimensional image to process.
    [0124] the two-dimensional image to be processed acquired by an image processing device can be a two-dimensional image, it can also be a frame image in a video playback, and it can also be each frame image extracted from a video acquired in real time, provided that it can be ensured that the image processing device can acquire the two-dimensional image to be processed.
    [0126] 512. align the two-dimensional image to be processed on a grid template.
    [0128] In this, the grid template is used to perform the grid division on the two-dimensional image to be processed. Especially, the grid template is used to perform normalization processing on the two-dimensional image to be processed, in such a way that the two-dimensional image to be processed of any size can be scaled in equal proportions, such that the size of the scaled two-dimensional image to process matches the grid template.
    [0130] 513. perform mapping processing on the two-dimensional image to be processed using a grid mapping table to acquire a first image.
    [0132] In this, the grid mapping table is used to represent the mapping relationship of the grid images. The grid mapping table can be indexed by grid numbers, or it can be specified in advance that the mapping relationship in the grid mapping table is stored from left to right and top to bottom according to the grid template (it is that is, the order of storage of the relevant information in the grid mapping table is specified in advance), or the grid mapping table can be indexed in other ways.
    [0133] The image processing device uses the mapping ratio stored in the grid mapping table to perform mapping processing on the two-dimensional image to be processed. For example, the entire two-dimensional image to be processed can be processed, or the two-dimensional image to be processed can also be divided, and the divided images, and the like, are processed. That is, the image processing device performs mapping processing on the basis of the two-dimensional image to be processed to form the first image. In this, the mapping relationship may be that the transformed image has a near end that appears large and a far end that appears small, or the perspective image can be deciphered through formulas and the like.
    [0135] 514. replicate the first image to acquire a second image.
    [0137] In this, the first image is a left eye image and the second image is a right eye image; or the first image is a right eye image and the second image is a left eye image.
    [0139] The inventor of the present invention has acquired through many experiments that the left eye image and the right eye image observed by human eyes are replicated images, that is, the second image can be acquired after performing replication processing in the first image acquired after mapping.
    [0141] 515. synthesize the first image and the second image to acquire the overlay image of the first image and the second image.
    [0143] The image processing device is used to synthesize the first image and the second image to acquire the superimposed image of the first image and the second image. The synthesized first image and second image can be output to image display means for subsequent three-dimensional image display. In this, the image display means may subsequently allow the images polarization directions of the two images are perpendicular to each other by adjusting the polarization directions of the left eye image and the right eye image. When a user uses the image display means, the three-dimensional image can be viewed by the user wearing a pair of 3D glasses. The adjustment of the polarization directions can also be done in other ways, as long as it is ensured that the polarization directions of the two images viewed respectively by the two eyes of a person are perpendicular to each other.
    [0145] According to the embodiment of the present disclosure, the grid template and the grid mapping table are used to perform the mapping processing on the two-dimensional image to be processed in order to simulate the left eye image and the eye image. right acquired by human eyes; that is, according to the method, the mapping processing needs to be performed on the same two-dimensional image to be processed only once, the left eye image and the right eye image can be acquired, and consequently the processing steps are reduced therefore, the image processing time is shortened and the conditions for monitoring the real-time conversion of the two-dimensional image superimposed on the three-dimensional image are provided.
    [0147] The embodiment of the present disclosure further provides an image processing method; and as shown in figure 2, the method comprises the following steps of:
    [0149] 521. acquire the two-dimensional image to be processed; and please refer to S11 of the embodiment shown in Fig. 1 for more details, which will not be repeated here.
    [0151] 522. align the two-dimensional image to be processed on the grid template.
    [0153] In this, the grid template is used to perform the grid division on the image two-dimensional to process. The grid template can be divided into a plurality of grids, each corresponding to a unique identification number as shown in Figure 3. It should be noted that the number of grids that are formed by dividing the grid template can be specifically set as a function of the actual conditions of use, not limited to the numbers shown in figure 3. Additionally, the coding method of the grids is not limited to this, and all the coding methods that can distinguish all the grids from each other fall within the scope of protection of this disclosure.
    [0155] S23. perform mapping processing on the two-dimensional image to be processed using the grid mapping table to acquire the first image.
    [0157] In this, the grid mapping table is used to represent the mapping relationship of the grid images. In accordance with the embodiment of the present disclosure, the grid mapping table comprises a number of each of the grids in the grid template; and the information of the mapped grid images corresponding to the numbers is stored in the grid mapping table.
    [0159] The grid mapping table can be expressed as follows:
    [0161]
    [0164] Especially, the mapping processing comprises the following stages of:
    [0165] 5231. dividing the two-dimensional image to be processed through the grid template to form a plurality of grid images to be processed.
    [0167] After the image processing device aligns the two-dimensional image to be processed on the grid template, the two-dimensional image to be processed is divided by dividing grids on the grid template to form a plurality of grid images to be processed. . In this, the numbers of the divided grid images to be processed are the same as the numbers of the grids in the corresponding positions in the grid template, such that the numbers can be used to query the grid mapping table to acquire the information of the grid images.
    [0169] 5232. acquire the numbers of the grid images to be processed.
    [0171] After the image processing device divides the two-dimensional image to be processed, the grid images to be processed are numbered with the respective numbers of the grids in the grid template. As described above, the numbers of the grid images to be processed are the same as the numbers of the squares at the corresponding positions in the grid template. Therefore, the image processing device only needs to extract the grid numbers at the corresponding positions and does not need to perform secondary numbering on the grid images to be processed, thus saving processing time.
    [0173] 5233. look at the grid mapping table and extract the information from the grid images corresponding to the numbers.
    [0175] The image processing device uses the numbers of the grid images to be processed to query the information of the grid images corresponding to the numbers in the grid mapping table. In this, the information from the images of Grid can be the size of the mapped grid images, or the coordinate data of each end point of the mapped grid images in the grid mapping table and the like. Optionally, according to the embodiment, the information of The size of the mapped grid images is stored in the grid mapping table.
    [0177] S234. processing the grid images to be processed using the information extracted from the grid images;
    [0179] The image processing device uses the size information extracted from the grid images to process the grid images to be processed. In this, the principle of the mapping transformation is illustrated in Figure 4. The mapping transformation means that by adopting the left side of an original image as the axis of rotation, the original image is rotated, into a screen, at a certain angle, and rotated, out of the screen, the same angle, in order to form, respectively, the center and the rightmost images in Figure 4. According to the embodiment, the size of the two-dimensional image to be processed is linearly scaled, such that the first scaled image and the second image achieve the effect shown in figure 4. That is, the image processing device performs scaling processing on the grid images. to be processed according to the sizes of the extracted grid images; and the scaling processing method may specifically comprise the following stages of:
    [0181] 1) . scan the grid images to be processed line by line.
    [0183] The image processing device scans the grid images to be processed line by line to acquire the sizes of each line of the grid images to be processed.
    [0185] two) . sequentially perform linear scaling on each line of images.
    [0186] The image processing device performs linear scaling on the sizes of each line of the grid images to be processed according to the principle that one end looks large and the other end looks small, and therefore is acquired the first scaled image. By sequentially linearly scaling each line of grid images, the amount of data processed is reduced and image processing efficiency can be achieved.
    [0188] S235. combine the processed grid images to be processed to acquire the first image.
    [0190] The image processing device uses the numbers of the grid images to be processed to recombine the images subjected to the mapping processing in order to acquire the first image.
    [0192] 524. replicate the first image to acquire the second image.
    [0194] In this, the first image is the left eye image and the second image is the right eye image; or the first image is the right eye image and the second image is the left eye image. Please refer to S14 of the embodiment shown in Figure 1, which will not be repeated here.
    [0196] 525. synthesize the first image and the second image to acquire the superimposed image of the first image and the second image. Please refer to S15 of the embodiment shown in Figure 1, which will not be repeated here.
    [0198] Compared to the embodiment shown in Fig. 1, the embodiment uses the sizes of the mapped grid images stored in the grid mapping table to perform scaling processing on each grid image to be processed, that is, the images of Grid to be processed are processed from the perspective of the image sizes without involving the resolution and the pixels of the images and other information. On the one hand, the image quality can be guaranteed; and on the other hand, the processing efficiency.
    [0200] The embodiment of the present disclosure further provides an image processing method; and as shown in figure 5, the method comprises the following steps of:
    [0202] S31. acquire the two-dimensional image to be processed; and please refer to S21 of the embodiment shown in Figure 2 for more details, which will not be repeated here;
    [0204] 532. align the two-dimensional image to be processed on the grid template.
    [0206] In this, the grid template is used to perform the grid division on the two-dimensional image to be processed. Please refer to S22 of the embodiment shown in Figure 2 for more details, which will not be repeated here.
    [0208] 533. perform mapping processing on the two-dimensional image to be processed using the grid mapping table to acquire the first image.
    [0210] In this, the grid mapping table is used to represent the mapping relationship of the grid images. Please refer to S23 of the embodiment shown in Figure 2 for more details, which will not be repeated here.
    [0212] 534. replicating the first image to acquire the second image, where the first image is the left eye image and the second image is the right eye image; or the first image is the right eye image and the second image is the left eye image. Please refer to S24 of the embodiment shown in Figure 2, which will not be repeated here.
    [0214] 535. synthesize the first image and the second image to acquire the superimposed image of the first image and the second image.
    [0215] The image processing device adjusts the distance between the left eye image and the right eye image formed after mapping processing to create the convergence angle. The inventor of the present application has learned through many experiments that when the distance between the images changes, the corresponding convergence angle changes. For example, as shown in Fig. 6, the relationship between the convergence angle and the distance between the left eye image and the right eye image is illustrated. As shown in Fig. 6a), when the convergence angle is ai, the distance between the left eye and the right eye is relatively small. As shown in Fig. 6b), when the convergence angle is a2, the distance between the left eye and the right eye is relatively large; and that is, as the distance between the left eye and the right eye changes, the toe angle will also change accordingly. Therefore, according to the present disclosure, the convergence angle is created by adjusting the distance between the left eye image and the right eye image. That is, the distance between the left eye image and the right eye image is adjusted in order to overlap the two images.
    [0217] The synthesis specifically comprises the following steps of:
    [0219] 5351. align a side edge of the first image with a side edge of the second image.
    [0221] In this, the center point of the lateral edge of the first image coincides with the center point of the lateral edge of the second image.
    [0223] The image processing device aligns the first image and the second image along the side edges thereof, and the center points of the aligned side edges coincide, corresponding to the first image and the second image, respectively.
    [0225] 5352. translate the first image or the second image along the center lines of the side edges to acquire the overlay image.
    [0227] The image processing device translates the first image or the second image along the center lines of the aligned side edges of the first image and the second image. One of the first image and the second image can be translated; or both the first image and the second image are respectively moved in opposite directions to form the superimposed image of the first image and the second image.
    [0229] Compared to the image processing method provided by the embodiment shown in Fig. 2, the embodiment has the advantage that there is a certain distance between the left eye image and the right eye image when translating the first image or the second image. image to create the toe angle. Subsequently, the three-dimensional image can be formed through the image display means of the three-dimensional imaging system in combination with the binocular parallax images and the convergence angle.
    [0231] An embodiment of the present disclosure also provides the image processing device; and as shown in figure 7, the device comprises:
    [0232] an acquisition module 41 for acquiring the two-dimensional image to be processed;
    [0234] an alignment module 42 for aligning the two-dimensional image to be processed on the grid template, the grid template being used to perform a grid division on the two-dimensional image to be processed;
    [0236] a mapping module 43 for performing mapping processing on the two-dimensional image to be processed using the grid mapping table to acquire the first image, the grid mapping table being used to represent the mapping ratio of the grid images;
    [0237] a replication module 44 for replicating the first image to acquire the second image;
    [0239] a synthesis module 45 for synthesizing the first image and the second image to acquire the superimposed image of the first image and the second image.
    [0241] According to the image processing device provided by the embodiment of the present disclosure, the grid template and the grid mapping table are used to perform the mapping processing on the two-dimensional image to be processed in order to simulate the image. left eye and right eye image acquired by human eyes; that is, according to the method of the present disclosure, the mapping processing needs to be performed on the same two-dimensional image to be processed only once, the left eye image and the right eye image can be acquired, the image processing steps therefore, the image processing time is shortened, and the conditions for the tracking real-time conversion of the two-dimensional image superimposed on the three-dimensional image are provided.
    [0243] In some optional implementation forms of the embodiment, as shown in Figure 8, the mapping module 43 comprises:
    [0245] a dividing unit 431 for dividing the two-dimensional image to be processed through the grid template to form a plurality of grid images to be processed;
    [0247] an acquisition unit 432 for acquiring the numbers of the grid images to be processed;
    [0249] a search unit 433 for searching the grid mapping table and extracting the information from the grid images corresponding to the numbers;
    [0251] a processing unit 434 to process the grid images to be processed using the information extracted from the grid images;
    [0253] a combining unit 435 for combining the processed grid images to be processed to acquire the first image.
    [0255] An embodiment of the present disclosure also provides an image processing means. As shown in Figure 9, the image processing means may comprise a processor 51 and a memory 52, where the processor 51 and the memory 52 may be connected via a bus or other ways. The bus connection is taken as an example in figure 9.
    [0257] Processor 51 can be a central processing unit (CPU). Processor 51 may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field programmable gate arrays (FPGAs), or other programmable logic devices, discrete gates, or logic devices. of transistors, chips such as discrete hardware components, or a combination of the above types of chips.
    [0259] As a non-transient computer-readable storage medium, memory 52 may be used to store non-transient software programs, non-transient computer-executable programs and modules, such as program modules / instructions corresponding to the image processing method provided by the embodiment. of the present disclosure (eg, the acquisition module 41, the alignment module 42, the mapping module 43, the replication module 44, and the synthesis module 45 shown in Figure 7). The processor 51 executes various functional applications and data processing by executing non-transient software programs, instructions and modules stored in the memory 52, that is, the image processing method is performed in the embodiment of the above method.
    [0261] Memory 52 may comprise a program storage area and a program storage area. data storage. The program storage area can store an operating system and an application program required by at least one function; and the data storage area can store data created by the processor 51 and the like. Additionally, memory 52 may comprise high speed random access memory, and may also comprise non-transient memories, such as at least one magnetic disk storage device, flash memory device, or other non-solid state storage devices. transients. In some embodiments, memory 52 may optionally comprise memories configured remotely from processor 51; and the remote memories can be connected to the processor 51 via networks. Examples of the foregoing networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
    [0263] The one or more modules are stored in memory 52, and when the modules are executed by processor 51, the image processing methods provided by the embodiments shown in Figure 1, Figure 2, and Figure 5 are executed.
    [0265] Specific details of the above image processing means can be understood by referring to the corresponding related description and effects in the embodiments shown in Figure 1, Figure 2 and Figure 5, and will not be repeated herein.
    [0267] The embodiment of the present disclosure also provides a three-dimensional imaging system. As shown in Figure 10, the system comprises the image acquisition means 61, the image processing means 62 and the image display means 63.
    [0269] In this, in the image acquisition means 61, a lens for acquiring images is a single lens and is used to acquire the two-dimensional image to be processed. The image processing means 62 is electrically connected to the acquisition means images 61, and are used to process the two-dimensional image to be processed as output by the image acquisition means 61. The image display means 63 are electrically connected to the image processing means 62 and are used to display the output of images by the image processing means 62.
    [0271] In the three-dimensional imaging system provided by the embodiment of the present disclosure, the lens in the image acquisition means 61 is a single lens, such that the volume of all the image acquisition means 61 is reduced; and furthermore, the single lens image acquisition means need only one data line to transmit the acquired image, such that the inner diameter of a connection line between the image acquisition means 61 and the media can be reduced. image processing 62, and the three-dimensional imaging system can be used on relatively small-sized objects, such as human organs, to perform three-dimensional imaging of human organs; and the application range of the three-dimensional imaging system is further extended.
    [0273] Those skilled in the art can understand that all or part of the processes in the methods provided by the above embodiments can be implemented by giving instructions to the relevant hardware through computer programs. Programs can be stored on a computer-readable storage medium. When the programs are executed, the processes of the embodiments can be included as in the previous methods. In this, the storage medium can be a magnetic disk, an optical disk, a read-only memory (ROM), a random access memory (RAM), a flash memory, a hard disk drive (abbreviation: HDD) or a solid state drive (SSD), etc .; and the storage medium can also include a combination of the above types of memories.
    [0274] Although embodiments of the present disclosure have been described in conjunction with the drawings, various modifications and variations can be made by those skilled in the art without departing from the spirit and scope of the present disclosure, and such modifications and variations fall within the scope defined by the claims. attached.
    权利要求:
    Claims (10)
    [1]
    1. An image processing method, comprising the following stages of:
    acquire a two-dimensional image to be processed;
    aligning the two-dimensional image to be processed on a grid template, the grid template being used to perform a grid division on the two-dimensional image to be processed;
    performing mapping processing on the two-dimensional image to be processed using a grid mapping table to acquire a first image, the grid mapping table being used to represent a grid image mapping relationship;
    replicating the first image to acquire a second image, the first image being a left eye image and the second image being a right eye image; or the first image being a right eye image and the second image being a left eye image; Y
    synthesize the first image and the second image to acquire an overlay image of the first image and the second image.
    [2]
    The method of claim 1, wherein the grid mapping table comprises the numbers of each of the grids in the grid template; and the information of the mapped grid images is stored in the grid mapping table corresponding to the numbers.
    [3]
    The method of claim 2, wherein performing the mapping processing on the two-dimensional image to be processed using the grid mapping table to acquire the first image comprises:
    split the two-dimensional image to be processed through the grid template to forming a plurality of grid images to be processed;
    acquire the numbers of the grid images to be processed;
    search the grid mapping table and extract the information from the grid images corresponding to the numbers;
    processing the grid images to be processed using the information extracted from the grid images; Y
    combine the processed grid images to be processed to acquire the first image.
    [4]
    The method of claim 3, wherein the information of the grid images includes the sizes of the grid images;
    the processing of the grid images to be processed using the information extracted from the grid images comprises the stage of:
    scale the grid images to be processed according to the sizes extracted from the grid images.
    [5]
    The method of claim 1, wherein the synthesis of the first image and the second image to acquire the superimposed image of the first image and the second image comprises the following steps of:
    aligning a side edge of the first image with a side edge of the second image by matching a center point of the side edge of the first image with a center point of the side edge of the second image; Y
    translate the first image or the second image along a center line of the side edges to acquire the overlay image.
    [6]
    The method of claim 1, wherein the two-dimensional image to be processed is a frame image in a video playback.
    [7]
    7. An image processing device, comprising:
    an acquisition module for acquiring a two-dimensional image to be processed;
    an alignment module for aligning the two-dimensional image to be processed on the grid template, the grid template being used to perform a grid division on the two-dimensional image to be processed;
    a mapping module for performing mapping processing on the two-dimensional image to be processed using the grid mapping table to acquire the first image, the grid mapping table being used to represent a mapping ratio of the grid images;
    a replication module for replicating the first image to acquire the second image; Y
    a synthesis module to synthesize the first image and the second image to acquire an overlay image of the first image and the second image.
    [8]
    8. An image processing means, comprising:
    a memory and a processor that are in communication connection with each other, where the computer instructions are stored in the memory, and the processor is used to execute the computer instructions, to implement the image processing method of any one of claims 1 -6.
    [9]
    9. A computer-readable storage medium, wherein the computer instructions are stored on the computer-readable storage medium and used to enable a computer to implement the image processing method of any one of claims 1-6.
    [10]
    10. A three-dimensional imaging system, comprising:
    an image acquisition means, comprising a single lens as an image acquiring lens, used to acquire a two-dimensional image to be processed;
    the image processing means of claim 8, electrically connected to the image acquisition means and used to process the two-dimensional image to be processed; and
    an image display means, electrically connected to the image processing means and used to display a three-dimensional image.
    类似技术:
    公开号 | 公开日 | 专利标题
    ES2813425A1|2021-03-23|Method and device for converting two-dimensional image into three-dimensional image, and three-dimensional imaging system
    US9774837B2|2017-09-26|System for performing distortion correction and calibration using pattern projection, and method using the same
    ES2813426A1|2021-03-23|Method and device for image processing, and three-dimensional imaging system
    EP3334156B1|2021-03-31|Electronic device for generating 360 degree three-dimensional image, and method therefor
    Arie-Nachimson et al.2012|Global motion estimation from point matches
    ES2400277B1|2014-04-24|FAST STEREO RECONSTRUCTION TECHNIQUES FROM IMAGES
    US20160295194A1|2016-10-06|Stereoscopic vision system generatng stereoscopic images with a monoscopic endoscope and an external adapter lens and method using the same to generate stereoscopic images
    CN102980513B|2016-01-20|Monocular full-view stereo vision sensor centered by thing
    US10373362B2|2019-08-06|Systems and methods for adaptive stitching of digital images
    CN106254854B|2018-12-25|Preparation method, the apparatus and system of 3-D image
    CN108288292A|2018-07-17|A kind of three-dimensional rebuilding method, device and equipment
    Ying et al.2012|Self-calibration of catadioptric camera with two planar mirrors from silhouettes
    François et al.2002|Reconstructing mirror symmetric scenes from a single view using 2-view stereo geometry
    Zhang et al.2016|Decoding and calibration method on focused plenoptic camera
    US10546395B2|2020-01-28|XSlit camera
    WO2014030571A1|2014-02-27|Stereoscopic image processing device, stereoscopic image processing method, and program
    Kee et al.2012|Virtual epipolar line construction of single-lens bi-prism stereovision system
    Gurrieri et al.2014|Depth consistency and vertical disparities in stereoscopic panoramas
    TWI531213B|2016-04-21|Image conversion method and module for naked-eye 3d display
    CN109003294A|2018-12-14|A kind of unreal & real space location registration and accurate matching process
    TWI725620B|2021-04-21|Omnidirectional stereo vision camera configuration system and camera configuration method
    KR101733346B1|2017-05-24|Orthoscopic real image reconstruction in integral imaging method by using elemental image modification
    CN111161122A|2020-05-15|Binocular stereo vision imaging method and system capable of rotating 90 degrees for imaging
    Zhang et al.2007|A Plane-based Calibration for Multi-camera Systems
    Lu et al.2014|A New Way to Factorize Linear Cameras
    同族专利:
    公开号 | 公开日
    CA3101222A1|2019-11-28|
    JP2021525032A|2021-09-16|
    DE112019002599T5|2021-04-08|
    RU2752421C1|2021-07-28|
    CN108737810B|2019-08-06|
    CN108737810A|2018-11-02|
    WO2019223523A1|2019-11-28|
    US20210203912A1|2021-07-01|
    引用文献:
    公开号 | 申请日 | 公开日 | 申请人 | 专利标题
    WO1997015150A1|1995-10-19|1997-04-24|Sony Corporation|Method and device for forming three-dimensional image|
    US20120140027A1|2010-12-06|2012-06-07|Teranex Systems Inc.|Pseudo-3d Forced Perspective Methods And Devices|
    EP2608554A2|2011-12-23|2013-06-26|MediaTek Inc.|Method and apparatus of determining perspective model for depth map generation by utilizing region-based analysis and/or temporal smoothing|
    US20130250053A1|2012-03-22|2013-09-26|Csr Technology Inc.|System and method for real time 2d to 3d conversion of video in a digital camera|
    CN105608666A|2015-12-25|2016-05-25|普瑞福克斯（北京）数字媒体科技有限公司|Method and system for generating three-dimensional image by two-dimensional graph|
    CN108712643A|2018-04-27|2018-10-26|苏州新光维医疗科技有限公司|Two dimensional image is converted into the method, apparatus and 3-D imaging system of 3-D view|
    CN108737810A|2018-05-23|2018-11-02|苏州新光维医疗科技有限公司|Image processing method, device and 3-D imaging system|
    US5357429A|1992-04-02|1994-10-18|Levy Richard A|Three-dimensional model generation using multiple angle tomographic scan planes|
    US8781557B2|1999-08-11|2014-07-15|Osteoplastics, Llc|Producing a three dimensional model of an implant|
    GB0101371D0|2001-01-19|2001-03-07|Virtual Mirrors Ltd|Production and visualisation of garments|
    CA2884702C|2006-06-23|2018-06-05|Samuel Zhou|Methods and systems for converting 2d motion pictures for stereoscopic 3d exhibition|
    US8274530B2|2007-03-12|2012-09-25|Conversion Works, Inc.|Systems and methods for filling occluded information for 2-D to 3-D conversion|
    EP2174301A4|2007-06-29|2011-11-16|Three Pixels Wide Pty Ltd|Method and system for generating a 3d model from images|
    CN101968895A|2009-07-27|2011-02-09|鸿富锦精密工业（深圳）有限公司|Two-dimensional image conversion system and method|
    JP2011186930A|2010-03-10|2011-09-22|Renesas Electronics Corp|Drawing control device, drawing control method, computer program of the same, and recording medium with the program recorded thereon|
    CN102905141A|2011-07-28|2013-01-30|联咏科技股份有限公司|Two-dimension to three-dimension conversion device and conversion method thereof|
    JP2013115668A|2011-11-29|2013-06-10|Sony Corp|Image processing apparatus, image processing method, and program|
    EP2868277B1|2013-11-04|2017-03-01|Surgivisio|Method for reconstructing a 3d image from 2d x-ray images|
    CN105096245B|2014-04-21|2018-05-04|上海澜至半导体有限公司|A kind of method and apparatus of processing 2D images|
    RU2600524C2|2014-07-15|2016-10-20|Федеральное государственное автономное образовательное учреждение высшего профессионального образования "Санкт-Петербургский государственный университет аэрокосмического приборостроения"|Method of converting a 2d image into a quasi-stereoscopic 3d image|
    JP6214820B1|2014-09-02|2017-10-18|コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ．|Device for visualizing 3D objects|
    CN105376546A|2015-11-09|2016-03-02|中科创达软件股份有限公司|2D-to-3D method, device and mobile terminal|CN108712643B|2018-04-27|2020-02-21|苏州新光维医疗科技有限公司|Method and device for converting two-dimensional image into three-dimensional image and three-dimensional imaging system|
    CN108737810B|2018-05-23|2019-08-06|苏州新光维医疗科技有限公司|Image processing method, device and 3-D imaging system|
    法律状态:
    2021-03-23| BA2A| Patent application published|Ref document number: 2813426 Country of ref document: ES Kind code of ref document: A1 Effective date: 20210323 |
    2021-12-17| PA2A| Conversion into utility model|Effective date: 20211213 |
    优先权:
    申请号 | 申请日 | 专利标题
    CN201810500309.5A|CN108737810B|2018-05-23|2018-05-23|Image processing method, device and 3-D imaging system|
    PCT/CN2019/085687|WO2019223523A1|2018-05-23|2019-05-06|Method and device for image processing, and three-dimensional imaging system|
    [返回顶部]